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ABSTRACT Reported is a variety of studies associated with the 

development of new elementary science programs in the Boulder Valley 
School District. Three approaches to elementary science were given 
field trials, one using textbooks based on a conceptual schemes 
approach, one based on the Elementary Science Study materials, and 
the o*her based on the American Association for the Advancement of 
Science "science - A Process Approach." Tests were developed to 
measure changes in childrens* critical and creative thinking, and a 
classroom observation system was developed to categorize teaching 
styles as expository, inductive, or indeterminate. In a later phase 
of the proiect, teachers were given a choice of a textbook- based or 
non-textbook course. Data are reported bearing on the effects 0 
curriculum materials, teaching styles, type of course ch 3 

teachers, and on changes in student critical and creative .^nkmg 
abilities. Both the expository and inductive teaching styles proved 
superior to the indeterminate style in producing changes in creative 
thinking; the non-textbook course favored creative thinking. Also 
reported is a study of the effect of different instructional methods 
for developing the concept of conservation at the first grade level. 
Appended are a report of the development of a group measure to assess 
pre-causal and pre-logical thinking in primary school age children, 
and copies of the tests of critical thinking and creative thinking. 
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Preface 



The program described ^jn thU repo rt^ has-been ^f unction mg^fo^a^^ttle^ 

research? 6 TlZoJTr Option of «h, -proj. act was 

between what is known about the ^"'sfruct iona 1 practices 

and how much of this ^formation i , t * assumption was that there exists 

and that this gap needs to be cosed science instruction that exists typically 
also a wide gap between the qual Y . „ teachers and scientists 

and the quality obtainable as demonstra e y instruction for elementary 
whose collaboration has produced new programs of instruct, 

sc i ence . 

it has been our belief that these two areas of concern were sufficiently 
related to justify their inclusion in a single effort. 

Certain hazards obtain from the adoption of ® r ?ng C f 1 nd i ng^must be con- 
frame of reference. Even themost su stan e uj P investigations in classroom 
sidered exploratory and descriptive for V mnlated much l°ss controlled, 

settings contain more variables than « * ^ftieal tests couid 

Many of the conditions on which .ests .researcher* ill doubtless point out the 

sometimes be met only marginally. a{ . ;„n a 1 ized definitions and better 

need for vastly delimited objectives, operationalized detinlt, of 

documented procedures. The practitioner on the othei hand may we I _ 

introspection, questioning and the expression of douh- to he p 

s i veness . 

The project has followed an adapt 1 what’daS'^ ' "e 

objectives through the process of making de c«s«ons alization that on l, 5 

obtained but tempered by subjective judgment with the real.zat °n 
small portion of .<-leva.it factors could be reduced to numerical 

Many anci ary undertakings occurred in conjunction with ® 

thrust of the proj J. An initial question ^^^^‘“.t^ntary science he 
mining the boundary conditions for curriculum chag ' uently re occurrirg 

design and development of measuring instruments was a frequently 

task . 
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CHAPTER I - OVERVIEW 



Context 

The Boulder Elementary Science Project had its beg i nn i J ^ 1 ence 
«;rhoo 1 district in a pilot program investigation of several elementary science 

schoo ” £ h‘ n 4 .^= r hers This pilot program began in the fall of 

study units by a group of 40 teachers. inis P"»«- H a ? iti , e * Der ience 

1965 and proceeded throughout the year. Growing out of this initial experience 

were the beliefs that 

1 Elementary science can be an appropriate vehicle to Foster creative 
and critUal thinking in children; in particular, act ,v , t , e wh , ch 
involve the children in an inquiry or discovery approach which would 
lend themselves to this goal. 

2 in order to overcome the barriers to implementation related 
teachers' attitudes, lack of involvement and Insecurity in dealing 
with new content, a change in strategy which would mvo.ve teach 
as co-researchers in the project, was needed. 

3 . A broad scale change affecting most classes in the district needed to 
be accompl i shed * 

A s a consequence of this pilot program,^ 

Ecucsvion Act e of t | 965 roV The°purpose of the project described Ir. this initial 
pi ,,:, -si’ were to 

!. Plan and operate an exemplary science program m the el ement ary ^hool 
levels which would help students to acquire the skills of critic 
and creative thinking. 

2. Increase elementary school teachers' understanding of creative think 
ing by involving them as co-researchers in this project. 

3. Acquire the instructional strategies used by teachers which success- 
fully elicit creative and critical thinking. 

The area served by this project is J «“{ f 

District Pe2 which comprises an area of 400 square miles ' 

of Boulder County, Colorado. The area's ma “"crowded by several 
1,000 students. A characteristic of the school d.s,r.ct wn.cn 
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the need for an appropriate school science Colorado' jo /government a 1 science 
the community, including the University of Colorado, »JO J the Bureau 

facilities, including the National Center industry. At the same 

of Standards, and a substantial Sc. ?"* f ‘ of social and economic variables, 
SIS so^Sen^ deftned^s^educat ional ly disadvantaged for economic reasons. 

The per pupil expenditure of the school district is hi^latlvj^o 
other 12 largest school districts .n he state 

year) and the pup i 1 teacher rat i c> » the* level of construction of new class- 

experienced a growth rate which ars of the project's operation, 

room space with the result that 9 y . much as 2,000 students, 

the enrollment exceeded the classroom -P c Y des ; gn ed as school class- 

resulting in the Jse of rented space o , t u_ t tbe project operated in 

rooms. This description should serve o sugg ^^ but which also shared many 

an environment which was ^ serving minor urban and suburban 

of the problems typical of school districts serv. y 

popular ions across the country. 



Phase I 

With the approve! of the project, a brief planmng^penod -•*»»■ 

May of 1966. A review of contemporary writing ^ega ^9^ air _ ng those respons- 
discloses that there are substantial d ' Tl ?^ are expressed in the kind 

ible for curriculum development. These d iff sciencC educational objectives, 

of materials developed to accomp i . 1 were identified by project 

Among the many shades of point ox v> > 
personnel as being representative. 

One belief is that skills in the processes of science which children 
develop are the most important outcome of the science progia . 

It is assumed that skills such as 

inferring, interpreting data, a " d ^Intiflc inquirer. With such an assumption, 
can become a mature, independent SCI ' [' J ' J t jona ] sessions can then be 
elements of content and the nature o. t wfn be more likely to occur, 

selected so that appropriate ski < p j eS : anf ,d from the process skills 

The most comprehensive » ’science Education called 

point of view are those by the AAftb commission 

Science, A process Approach. 

• A hw Tnnkina to the conceptual structure of 
Another viewpoint is gained by ruction. There are large conceptual 

science for a way of organizing remain quite stable over long periods 

schemes within the oody o scienc , **ubiect to more frequent modification 

of time as contrasted with facts which are subject J° ™ Science 

or change. The efforts of a c “ r |[ 1 1 j st of conceptual schemes which can 

Teachers Association provide a curriculum. A next logical step is to 

rerve as an organizing structure ^ or J*® c . concepts, arrange these in order 
break major conceptuai ^^me S .nto auppo „ st 9 ructured to 

of difficulty and emerge with a science 
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5 students with the central ideas in science. Such a reference frame has 
I ted in several textbook series which provide a logical and sequential 
lopment of the central body of scientific knowledge. 

Yet, a third point of view is that each student must build his own organ;- 
principles and structure the world of science for himself. Logical struc- 
s superimposed on the student's thinking are considered not likely to cause 
than superficial changes unless actively assimilated by the student, ine 
tegy for insuring s high levs! of student involvement consists of prov icing 
r.v i ronment replete with discoveries to be made and phenomenon to be investi- 
d. The choice of content elements depends upon how interesting the material 

0 students and whether or not it is appropriate for the student's own 
stigation. Material produced by the Elementary Science Study of Educational 
lopment Corporation is representative of this third point o> view. 

With these options vail able and with each having a substantial group of 
ly competent advocates, it seemed imperative that development of an exemplary 
entary science program be broadened to include more than one point o< view 
that a field trial implementation of the alternatives be undertaken. The 
ning phase concluded with the establishment of a comparison between a process 
oach to elementary science, a concepts approach to elementary science and a 
overy approach to elementary science. Each of these programs was established 

1 comparable setting involving six teachers a* each grade level. Contempor- 
iusly with this design was the development of programs of inservice education 
■quip teachers to deal effectively with the three programs. These programs 
nservice education included ©s resource teachers with experience in the 

>t program and consultants from outside the district who .>ad a degree of 
srtise with the new science materials. This three-program comparison was _ 
lucted on a school unit basis with principals agreeing to undertake a partic- 
• program as assigned by chance and the teacher assigned to those schools 
>d to participate. Anticipated outcomes were several. One outcome was the 
irmi nation of what effect, if any, science curriculum change would have on _ 
Idrens* critical and creative thinking. Also, boundary conditions for curri- 
lm change In terms of program acceptance and feasibility were matters to be 
jrmined. The teachers who had initially participated in the pilot program 
s continued in that program with a considerable expansion of the number of 
bS in use. 

Addi tonal planning and developmental work went into the implementation 
assary for the measurement of creative and critical thinking and into the 
3 lopment of a model of ass room interaction. 



se 1 1 

Principle findings of this first year investigation were complex. First, 
e of the curriculum designs— ‘process t concepts or discovery “-we re universally 
eptable to teachers. Each program had its supporters and detractors. Ex- 
sive comment was obtained by participating teachers and specific, differences 
ween the programs in terms of the reaction of the teachers was 

r 




analyzed. Many of the difficulties were centered m the quality, timeliness 
and appropr i oteness of materials acquisition. However, another important part 
of the teachers 1 respcnses-'-both negative and pos? tive—turned on such issues 
as philosophy, teaching style, class management skills and other fundamental 
issues. Responses from parents indicated that either of the two non-text 
programs--process and discovery — was more acceptable to parents than the text- 
based concepts approach. The changes in creative and critical thinking as 
measured by the testing program were not attributable to curriculum. The 
changes were attributable, however, to the influence of individual teachers 
with some classes showing gains and other classes showing losses, particularly 
in the area of creative thinking. This collection of data did not support a 
simple decision, i.e., to adopt one program in favor of the other two. In 
fact, the intensity of responses suggested that such a simple decision was not 
tenable. There were modifications for which a clear need was indicated.^ These 
changes pertained to supply and equipment acquisition and the strengthening of 
certain weak points in the non-text programs. Two considerations emerged from 
the three-program comparative study. One was consideration of the premise that 
an exemplary elementary science program should accommodate substantial teacher 
variability to the extent that perhaps a selection of alternatives would prove 
more beneficial to everyone than any unitary choice. The second consideration 
was that although based in opposing schools of philosophical and psychological 
thinking, in practice, the two non-text programs proved more alike than differ- 
ent, particularly when compared to the text program. This observation coupled 
with the weak spots encountered in non-text programs, led to an attempt to 
merge process and discovery science teaching approaches into a single non-text 
sequence. This sequence had the major emphasis of the process approach in the 
primary grades with some components from the discovery approach and major 
emphasis on the discovery approach in the intermediate grades but with some 
contributions from the process approach. 



Phase jJJ 

A question emerging from the observations of changes in creative think^ 
ing encountered during the second phase was could the teacher attributes which 
influence creative thinking be identified? This question was posed in the 
form of a study to relate changes in creative and critical thinking to class- 
room teaching behavior* An expos i tory- induct ive teaching style mode was pro-^ 
posed and a rating scheme evolved by which videotape recording of class activi- 
ties could be analyzed. A sample of teachers were selected and classes pre- 
tested in the fall of 1967 and again tested In May of I960. 

In the intervening months videotapes of science instruction were made 
and analyzed. The conclusion from this study was focused on three instructional 
types: Teachers who use a predominantly expository style, teachers who use a 

predominantly inductive style and teachers whose style defied classification 
in the expository-inductive continuum. The Influence of teaching style on 
critical thinking as measured by the tests developed proved to be minimal. 
Creative thinking, however, was influenced favorably by teachers with either a 
predominantly expository style or by teachers with a predominantly Inductive 
style as contrasted with the losses in creative thinking associated with teachers 
of indeterminate teaching style. 



In the spring of 1968 as these results were becoming known, decision 
was made to provide a text or non-text alternative and extend to teachers the 
option to elect one or the other alternative for the 1968-69 school year. Such 
a choice was extended to all the teachers with an elementary science te ch 9 
responsibility and approximately one-half of the more than 400 teachers electe 
the text alternative while the remainder elected the non-text alternative. 
During the summer of 1968, materials to implement these choices were °^' ned 
and distributed and inservice education activities were designe o a 
teachers in strengthening their work with the materials of their choice. 



Phase I V 



run c t \/ 1 o «tudv was conducted in classrooms outside the 




and non-text alternatives. This provided a means of _ ... . 

tionship between critical and creative chinking and classes in which teachers 
were using science materials of their own choosing. Children from ese 
initial schools were again tested with instruments designed to measure creative 
and critical thinkinq and also science achievement. Data from this testing 
program again suggested that changes in critical thinking are minimally affected 
in this case a combination of teacher and program, but that creative t in ing 
scores are higher in classes where non-text materials are being used by teachers 
than scores :n classes where the text materials are the selection of the eac er 
Achievement as measured hy the STEP science battery is high in both groups as 
compared to published norms and favor slightly the non-text classes but no 
significantly so. The practice of extending the opportunity to choose programs 
has been continued and in the selection of materials in the 1969“ 70 school year 
follows approximately the same pattern as the 1968-69 school year except that 
there is a small increase in the percentage of teachers selecting the ex 
app roach. 



A limited study of the effectiveness and efficiency of different instruc- 
tional styles suggested that with first grade age children, an instructional 
strategy through which the child receives feedback directly from the envi ronmen 
in the form of a balance scale is superior in effectiveness and equal m 
efficiency when compared to instructional strategies which utilized either 
teacher or peer interpreted data. 



The text and non-text alternatives are being continued as a part of the 
regular instructional program past the termination of federal funding. A 
program of new teacher inservice education, and provision for continued adaptive 
change of the programs, has been established. Other work to investigate problem 
which have arisen as a result of this project are under study. 



Subsequent chapters of this report present the description and findings 
of the project in more complete detail,. 
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HAPTER II - A FIELD TRIAL OF THREE KINDS OF ELEMENTARY SCIENCE 



l. Introduction 

The work of curriculum development groups has served to increase the 
ariety of science programs available to schools. These programs show the mark 
,f talented scientists and teachers and. come with the endorsement of qualified 
iuthorities and present a difficult choice for schools. 



No matter how well conceived, a program of instruction is 
as it is implemented in terms of daily it. enactions among teacher, 
and materi al s. 



only as good 
chi laren 



Having undertaker, the task of .. rablishing an exemplary e.ementary 
ience project, ^he decision was made o ‘'ase selection of materials on as 
empirical basis a possible. A field tie of mater i al s was des gned to tes u 
the feasibility of materials and their effectiveness in improvmd children s 
thinking. The critical and creative thinking outcomes were selected because 
af their importance and because they would not obtain more directly rom one 
approach than from another as would be thecase if process skills or conceptual 
information or inquiry skills were evaluative criteria. 

The cirricula included in the trial and the nature of the treatment are 
described under the following headings of Concepts, Discovery, and Process. 

Concepts - Students study science in the order and manner suggested in 
the 1966 Harcourt, Brace and World science series, Cp . ncepts in Scien gg. uc 
Study includes the reading of narrative and descriptive material in the text, 
such laboratory investigations as are suggested in the text and deemed appro- 
priate by the teacher. The Harcourt, Brace and World kits of materials are 
made available to the classes and used in the manner prescribed. eac ing 
tests are utilized in grades 3 through 6. The structure of instructional 
sessions and the sequence of topics is relatively strong and de ermine Y 
teaching guides. This := ^ncidprpH as a textbook-cen .ered apprach. 



Pi scovery 
the Boulder Publ 



treatment is considered as a textbook- 

- Students study science in the order and manner suggested by 
the tfouiaer ruDiic Schools 1 Science Guide# This is predominantly units pro uce 
by the Elementary Science Study of Educational development Corporation (formerly 
ESI), augmented by additional units developed locally to provide for a year s 
study in science at each grade level# 

The units are introduced by giving students direct experience with a 
p robl errr p rovoki ng situation. 

Materials are provided for individual student manipulation and consist 
principally of kits of materials developed by the Elementary Science Study, 
commercial versions obtained from the Webster Division of the McGrav. 1 . u . 

1 ishing Company. This treatment is considered a relatively unstructured inquiry 

approach. ^ ^ 
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Process - Students study science in the order end 

ere obta.neS tr^ 'the Idea, School Supply of 

Mecel ester Scientific Company. I nst ruct I ona jn teac hing guides. 

TM s° t reatment^T s^cons^dered Jbl I ^ess-centered approach and is relatively 
strongly structured along process skill deyelopmen 

The district elementary schools were studied i 
factory populations for comparison purposes. ® p 
was feasible allowed for the inclusion of six teachers 
Schools which had a large number of pilot program teach - 
year or which were atypical for some reason were n °* s 
in selected schools were asked to participate an 



c . . 

of 



r to find sati s- 
ie pr ij act wh i ch 



-ade 

-om 

d . r 



er treatment, 
e p revi ous 
1 1 teachers 



The following table summarizes the 


des i gn : 




Treatment -- — 


— 


Concepts in Science, 


"Pred i sci p 1 i na ry 
1 nqui ry , ESS units, 
auqmented locally 


Hr O bei Icb , 

Science. A Procss: 




HBW series 


Approach 


1 y ptj j li luu i 

New neighborhood 
school st . 


29 teachers 
832 students 


23 teachers 
718 students 


27 teachers 
734 students 


M- t eacne rs/ q raae 

Establ i shed 
ne i ghborhood 
school s 

O 4- Aarhct rc / n r A rl P 


16 teachers 
373 students 


14 teachers 
335 teachers 


14 teachers 
406 students 


Z LGaCiitll b/ H 1 c,uc 

Tota 1 s 


45 teachers 
1 .025 students 


37 teachers 
1 .053 students 


4l teachers 
1 , 140 students 



An additional 5 teachers per grade who were not . - 

were identified and their students tested for control pu. po.es. 

Outside the experimental design, another lOO.te^hers ^rticlpated^ln a 

program designated as ''eclectic''. a °' 0 “T^”ts of the other two 

to the Discovery materials (ESS), there pilot program teachers 

of 6 th^prev! ou^yea r , «y*-£ -r. first year teachers and twelve 

of these were parochial school particpants. 

All 223 teachers, both within and outside the experimental design, par- 

"l^^’Jiyr^rt^irp^a^ar^ra-^prate gride level. The 
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cal project teacher attended three half-day inservice sessions and three 
r-school meetings for a total of about fourteen hours of mserv.ce act.vi y. 



:hosen 
n used 
ere 
er 



Measu rement 1 nst ruments 

Crea tive Thinking - The Torrance Tests of Creative Thinking were 
he best" available measures of creative thinking. fhe f igural test 
grades 1 2, 3, 5 and the verbal form for grades 4 and 6. The test, 

nistered to a randomly selected sample of children consisting ° s '* c 
s in September and May. Forms A and B were alternated as pre and p -- 

s . 

Critical Thinking - In the absence of appropriate measures available ^ 

, oth^TsS^rcasT twoi nst ruments were developed to measure critical th g. 

called the "Boulder Picture Test" was designed for use with chi ldr„.i 
les 1, 2 and 3. The other called "Critical Thinking in Science- was 
Hoped for grades 4, 5 and 6. Pretest information was obtained ,n October 
the Picture Test; however, time limitations precluded pretesting 
:ical Thinking for grades 4, 5 and 6. 

In order to determine the direction for future development information 
collected from three principle sources. First, the opin .< on and . eval 1 uat.. on 
aa rt i c i pat i ng teachers was gathered by means of n questionnaire o m pp 
the end of the school year. Second, informal on was obtained frorn a 
pie of parents whose children were in participating classes. ina v, 
critical and creative thinking were given to a randomly selecte sampie 
Idren in the three science programs. 
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B # Summary of Teaching Experiences 

auestionnaire forms were completed and returned by P- r t ,c >P^jn9 
teachers. The evaluation team read and tabulated the returned questionnaires 
and members of the team summarized "he responses into this narrative iotm. 

The replies were sorted into five groups representing somewhat common^ 
experiences. Participation in groups 1, 2 and 3 was estab.is e y ' 

all of the teachers in a particu ar school participating. Teachers ,n -hese 
q roups were representative of the school district as a whole an, it is reason 
able to expect that the same degree of successor failure can be expected with 
the several programs if tried on a district-wide as is. 

Group 1 used the program made up of Elementary Science Study units aug- 
mented by locally developed units. This program has come to be knownas uhe 
"Discovery" approach. Group 2 used the program used the AAAS Comm. * S ' 

Science Education known as the "Process" approach. Group 3 use 
Brace & V/orld science series and has been called the Conceptua 
approach or "Concepts" approach. Groups k and 5 used the s ame . p rog r am f S 
group 1 but are considered separately since the participants might not ^ . 

typical of the school district as a whole for one reason or another. P 

consists of volunteers who actively sought out participation in e oject.^ 
They are scattered among most of the elementary schools m the * 

group also includes teachers frow the parochial schools. Group 5 '"eludes 
those teachers who were in the original pilot program and who are complet.ng 
their second year of participation. 

interesting differences of opinion developed among the five groups, 

1. Group 1 - Discovery Appraach 

Responses were received from the 3*+ °f the 37 teachers in this group. 
These responses were sorted Into three categories*— favorable, un avora e ° 
neutral-on the basis of whether the overall evaluat.ve statements were favor 
able towards the program, unfavorable towards the program or whether an equal 
number of favorable and unfavorable comments were made. There were lfc> in 
favorable group, 7 neutral responses and 11 responses which were clear y 
unf avorabl e. 

Comments made on the questionnaires classed as favorable included 
mention of high student interest and opportunity for individual | participat • 

Most favorable responses came from kindergarten, fifth and six g . 

Even among favorable responses there was concern expressed for lack of quantity 
or poor timing of materials, not enough inservice activity and there was some 
scattered criticism pertaining to lack of organi zation„ 

The neutral group commented extensively, pointed out the need for more 
materials, that the program needs to be augmented and extended, expressed dis- 
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ic 



roval of the quality of the inservice 



and the lack of structure. 



The unfavorable group was very strong in criticism of the program- Tie 
ticisms were strongly stated and the participants took the tir- to write 
g comments. The material supply was the problem most strongly stressed tut, 
addition, the equipment was criticized on the grounds that it s unsuitable 
dangerous for use in the classroom. The inservice activities were callea 
te of time and poorly organized. The organization of the materials or ^ 
chers were criticized, not enough information of a content sort provided or 
chers, and there were several suggestions that textbooks were nee e . 



sufficient materials fc r 



In summary, the logistic problem of supplying . 

lividual student use and at the proper time was identified as a principal 
igram shortcoming. This difficulty hindered some teachers and overwhelmed 
iers . The other severe shortcoming identified by these teachers was the ack 
direction or organization. The suggestion that children can learn 

discoveries was frequently rejected outright 

“the program 

9 a 



st ructure , 
thwhile things through their own 
i nd i ca 
not su 



e things through their own discoveries wcj^ • i6 H ucllvi r 

ted by those who used few or no units on the grounds that t 

itable to classroom size and problem’ 1 or H 1 can t^see lettin 

/-\rk k s c r\ufn - - -h h<=s\/ d i rect i on and Guidelines* This is 

1 1 



ident go on h5s own--tbey need direction and gu 
ilosophy but it doesn't work to just let them go 
jponses were received from teachers of first and 



This is great 
Part i cu 1 a r 1 y unfa vorabl e 
fourth grades. 



Group 2 - Process Approach 

Thirty-seven responses were received from the 40 participants using the 
rocess" approach materials. Of these 24 responded favorably, 10 neutral and . 
vrote negative responses. The favorable responses were frequently enthus i ast i c 
dicating the belief that the program was more effective than the previous 
pe of program and that the students became more involved and more intereste 
science. There were concerns expressed about the teacher ' s adequacy and 
ggestions that more inservice was needed were frequent, particularly in t e 
per grades. These comments generally had a positive tone with the expression 
at the teacher expects to do a much better job next year. 

The neutral group considered preparation time required to be excessive, 
e teacher guide too technical t arrival of materials tardy. The neutral group 
so suggested that storage of the materials was a problem, specialists were 
eded and that the material was too hard for the children. 

The unfavorable comments most frequently came from first and fourth grade 
achers and suggested that the program is too hard, the children not ready anc 
e teacher preparation time too great. Some suggested that the program included 
o much discussion material and that the interest of the children were not 
imulated. Two simply stated it was disappointing. 

In summary, this program seems to have been well received by the majority 
teachers, the notable exception being first grade, but the overall tone was 
is i t i ve with criticisms accompanied by suggestions as to how the problem can 
: overcome in the future. The equipment did not always arrive in time, howe .-?r. 
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s quantity and appropriateness seemed 
lount of concern expressed about the t 
ving organisms or consumable supplies 
omising response was the very general 
fects on the children. 



satisfactory. There was a certain 
ime consumed in getting the necessary 
needed for the activities. The most 
belief that the program had favorable 



Group 3 - Concepts Approach 



Thirty-six teachers out of 41 responded, 2k responded favorably, 9 wi 

2u tral comments and 3 responded unfavorably. Tea, chers . res P ond ^ f ^ouqhi 
id i cated that they had enough materials to use for a change. Some thought 
lere was too much mater!., to cover comfortably. There 

oologies for not having covered the entire text. The avo gnd texts _ 

rally expressed satisfaction about having materials, curric 



wi th 



relatively few comments but 

-- >" that "deviation from the 

of the 



Some parts 
suggested that 



the 



The neutral group made relatively tew comments out did include suggestions 
hat units didn't allow enough time "to materialize 
ext was necessary to clear up questions which came up. 

ext were called too easy, others too hard. One teach* D roduced less 

uide was too didactic and that following the sections s “ 9 gest*^ produced less 

nterest in science. Another thought the concepts too arge 

Participants responding unfavorably suggested that they ^antedfewer 

each one, that there was too much reading that 
of their own experiments and the children did not 
iecome involved. They also indicated that there was too much mat 
was followed too closely* 



inits and more time spent on 
children did not do enough 



ju i de 



1 n 

pleased w 



summary, participants in this program seemed ^[ally satisfied or^ 
ith the concepts approach although a few felt constr by 



;omments were generally mild in nature, favorable comments as 
;omments. This program seemed to fit the teachers expectati 

Group k - Discovery Approach , Volunteer Teachers^ 



ons , 



Forty-nine out of 66 teachers 
■esponded favorably, 17 neutral and 3 



in this group responded, 
responded unfavorably 



Twenty-n i ne 
The favorable 



esponded ravoraoiy ■ / ""““r' m ca used children to think and develop answers 
roup sugqested that the program caused cmiuicn w , . h j pq ; rs b 

o questions, some suggested that the bigger var.ety of units des, r.b 

lany reported there is much interest and enthusiasm among the children. The 

’avorable group also indicated materials were too late in arriving, some felt 

naterials were too few in quantity. More workshops were requested. Other 
nateriaib weie iuu M . . n,. ,., u cripnee" "kids have learned to ask 

favorable comments were that it is "lively science , K, °f „ 

questions about things" and "it is fascinating for the children. 

The neutral group commented that the teacher materia 1 s were sometimes 
^ard to follow, more units with more materials were needed , plann mg of the 
meetings could be improved, timing of the materials should be .mproved. 

The unfavorable group had similar comments about the materials problem 

- 1 ll-7 



1 e . 




the lack of structure existing in the program, 
larder to control and that the children lost int 
. j- • mntfi nt was needed in 



jut centered comments on 

r eel that the class was hai^. , , 

if ter an initial interest, and finally, that more content was needed 

to prepare for junior high school. 



They 

erest 

order 



In summary, this group was about evenly divided 
giving favorable responses and neutral responses. me 
enthusiastic; large differences between reception at di 
did not appear- 



between 
f avorab 
ff erent 



part i ci pants 
le responses were 
grade levels 



5- Group 5 - 1965-66 Pilot Program Teachers 



Twenty-nine responses were received from 35 teachers fi n 1 shi ng t-heir 
second year. Fifteen responses were considered favorable 10 neutral and 4 
considered unfavorable. Virtually all of those participants had provided favor 
able responses at the end of their first year s experience. 

The participants responding favorably indicated that the program is of 
great potential In terms of its favorable effects on c.i f®"* . . j n . 

was only partially reached because of supply problems and i evaluation 

service opportunities. Some concern was expressed about means for ^'“ atlon 
and whether or not the children were going to be prepared for junior 9 

The neutral group suggested that there was a lack of supervision, 
inservice or involvement as well as materials proolems. 

The four unfavorable responses included excessive time requirtmen 
lack of structure in the units and lack of tangible results as oar * * 

suggested that a -whole year of this kind of work gets bonng ; -othe^sa , d^ 
"discovery is a good technique but it can not be used to th_ 
techniques." 

In summary, the experienced teachers seemed to suffer a 
siasm from their previous year's experience. f with the 

otherwise but there was evidence of a feeling of dssaf i . hiah and 

program objectives. Concerns for evaluation I ^IhrM as JlTf ir a "good iext". 
a balance between teaching techniques appeared. Three asked tor y 



6. Global Comparisons 



impressions about the degree of acceptance of 
evaluation team read the responses for a 
overall response by grade as unfavorable, neutra 
n + ++) These crade level ratings were 

then summarized and members of the evaluation team made comparisons b, etween the 
nrn.mc: Thpre was General agreement among judges about the relative 



In order to obtain general 
the three programs, members of the 

^^nd'^’f^Sl^-; o. ♦ . «->•• These e rade level retings were 



different groups 
position of the 



There was general 
Afferent groups. 



For the situations in wh 



ich all teachers in a given school participated, 
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2 - Process Approach rated highest followed closely by Group 3 - Concepts 
ach. Group 1 or the Discovery Approach was rated as least favorably 
/ed. The differences between Group 3 and Group 1 were greater than 
an Group 3 and Group 2. 



1 Unfavorable). 



(Favorable .2*.3*««* 

For the three groups using the Discovery Approach materials, the order 
roup 4 - New teachers participating by request— responding most favor y, 

5 - Second year participants next, and Group 1, again responding least, 
ably Groups 4 and 5 were again closer in response than Groups 5 and I . 
rable . 4 .. 5 1 - Unfavorable). 

esponses of Parents 

A questionnaire was sent to parents of children in the three experimenta 
s to establish if there were differences in the children participa <g 
cience programs which were observed by parents. These three trials corres^ 
to teacher groups 1, Z and 3 in the previous discussion. Pa ^ en ^ 5 
•ted randomly from student lists, and contacted by telephone to dete mi 
iey would complete the questionnaire. The 1 i rst response an one o 
sst produced better than a 90 % return* 

The first question was "Were you aware prior to this letter fjjat your 
i's class was taking part in a new science program this '/ear? Responses 
-ated that virtually 100% of the parents of children in the Discovery 
aach were aware that the children were participating in a new program, 
sximately one-half were initially informed by the children and one-half by 
teacher. Eighty percent of the parents completing the quest .onnai re in 
the Process Approach and Concepts Approach were aware that their chi en 
participating in a new program and the children and teacher a so cons t u e 
nain sources of information. 



The second question was "Have you observed a change during the year in 
ii Id's interest in school- rel ated science activities? (i.e., bringing 

study.) 



initiated at school for additional 



chi 

proj ects 

The table shows the responses of parents whose children were in the three 
erent science programs. 





Di scovery 


Process 


Concepts 




lore Interest 


54% 


48% 


22.5% 




lo Change 


42% 


50% 


70% 




.ess Interest 


4% 


2% 


7.5% 





- Interest 



in School Related Science Activities 



IS 
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ERIC 



TABLE I 



The third question was "Have you observed a change during the year j n 
your child's part icipating in science related activities outside the school 
program?" ( i . e . , choice of reading, projects, questions). Responses of 
parents of children in the three science programs are shown in Table II. 





D i scovery 


Process 


Concepts 


More Interest 


53% 


44% 


21% 


No Chanqe 


47% 


56% 


79% ... 


Less interest 




. 


- 


TABLE 1 1 

The fourth 
effectiveness of 
the parents. 


- Interest in Outside Science Activities 

question was "Have you formed an opinion about the merit or 
the new science program? Table 111 shows the responses o 




Discovery 


Process 


Concepts 


Favorab 1 e Op i n 


ion 48% 


46% 


1 1% 


No 0 d inion 


52% 


54% 


84% 


Unfavorable Ooinion 




5% 


TABLE 1 1 1 


- Parent Opinion about Science 


Program 



From this information it seems that the impact of the Discovery and Process 
Approach on parents was approximately equal. Parents whose children were n 
the Discovery Approach reported slightly more favorable cnange in their child s 
interest in school and outside school science activities, while many more 
parents were asked about their opinion with nearly one-half of e p P. 
the Discovery Approach and Process Approach reporting favorable °P 1 " 1 w! J ' J.® 
the majority of the parents of the children in the Concepts Approach had formed 

no opinion. 



D. Tost Results 

1 . Creati ve Thinking 

A sample of 6 children-- 3 boys and 3 girls--was selected, using a table 
of random numbers from each class in the Concepts, Process, and Discovery 
programs. In addition six children were selected from six other classes in the 
district where none of the science programs were being used. This latter group 
was designated as a "Control." The ‘Torrance Tests of Creative Thinking were 
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dministered to these children during September and again in May. Half of the 
hildren in each program received Form A followed by Form B, e . 

eceived For,, B followed by Form A. The figure! test was given to children 
n Grades \ 2 3 and 5 The verba] form was given to children in grades 

" The "igurai e h four separate scales-Fluency, F 1 «Ib 1 1 1 ty . Or . g . na 1 - 

iy and Elaboration. The verbal form has three scales--Fluency Flex.b , 1 ,ty , 
nd Originality. A brief definition of these scales is as follows. 



FI uency 
F ' exib i 1 i ty 



- The number of relevant responses produced. 

- The number of shifts in thinking or number of different 

categories of questions, causes, themes or representa- 

t i ons. 



Original i ty 



- The statistical infrequency of these questions, causes, 

themes or representations or the extent to which a response 
represents a departure from the obvious or commonplace. 



Elaboration - The detail and specificity incorporated into questions 
causes, themes or representations. 



sea 1 es 
s i gnl f 


The fol lowing 
was obtained 
i cant) . 


table of signi 
from a one-way 


ficance levels for changes in the creativity 
analysis of variance. (N=653 , ns-not 








Scale 




U 1 ouc 


F 1 uency 


Flexibility 


Originality 


Elaboration 


1 


n. s . 


n . s . 


n . s . 


n.s. 


2 


n . 5 . 


n . s . 


n , s. 


n.s. 


3 


n . s . 


n . s . 


n . s . 


n.s. 


4 


97.5 


n . s . 


n „ s « 


— — “• 


5 


90 


n . s . 


90 


n.s. 


6 


97.5 


90 


n.s. 





TABLE IV - Differences Among Treatments 



Inspection of Table IV suggests that no important changes are attributable to 
science curriculum treatment. 
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V/hen the analysis is repeated with class membership (teacher influence) 
as the variable of interest the following table is produced. 



Grade Scale 





F 1 uency 


FI exibi 1 i ty 


Or £ q i na 1 i ty 


Elaboration 


] 


99.95 


99.95 


99.95 


99-95 


2 


99.95 


n. s . 


95 


99.95 


3 


90 


99-95 


99.95 


99-95 


4 


99.5 ■ 


99.9 


99.5 


— 


5 


90 


99 


90 


99-9 


6 


97.5 


n . s . 


99 






TABLE V 


- Differences Among 


Teachers 1 





A further analysis by means of a one way multivariate analysis of variance 
(profile analysis) collapsed the data for four scales and produced the follow- 
ing composite for teacher influence. 



G rade 


S ignif i cance Level 


1 


99.95 


2 


99.95 


3 


99.95 


4 


99.95 


5 


99.5 


6 


99.95 



TABLE VI - Differences Among Teachers II 



The interpretation of these results is facilitated by considering the 
following example which shows the first two class results printed out in the 
analysis of variance for teacher influence. 





F 1 uency 


Flexibility 


Or i g i na 1 i ty 


E laborat i on 


Teacher 1 


-16.4 (loss) 


-1.4 (1 oss) 


-2.0 (loss) 


-12.4 (loss) 


Teacher 2 


+18.0 (gain) 


+6.8 (gain) 


+32.2 (gain) 


+24.0 (gain) 



TABLE VII - Average Change in Raw Score Units in Two First Grade Classes. 
(Pretest: October, 1966, Posttest: May, 1967) 
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Teachers 1 and 2 were using the same science curriculum materials, in the 
same school and in adjacent rooms, but they clearly did not produce the same 
effect on children's creative thinking. 



2 . Critical Thinking, Grades 1, 2, 3 

During the year a cartoon format test called the Boulder Picture Test of 
Pre-cr i t i ca 1 Thinking was developed. This test contained items in three sea es 
measuring Conservation of Substance, Spatial Relations and Logic. Table VII 
shows the mean raw scores for grades 1 , 2 and 3 taken together. Approximately 

i 4- L ^ Dniil dnr Kt rrnro loci* I Q 



included in the Appendix - 


Discovery 


Process 


Concepts 


Cont rol 


Conservation 5.56 


5.29 


5.32 


5.32 


Relations 3-70* 


3.37 


3.24 


3.20 


Ln q in 4. 46 


4.25 


4.27 


4.34 




TAtSLE VIII 






*Discovery meanly concepts or 


control means at 


.05 level of 


s i gn if i cance. 



Hie table shows that mean scores of children in the Oi ^ Y P | 
tend to be slightly higher than in the other programs. in one c ^e the differ- 
ences between the mean scores in the Discovery program over the means in the 
Concepts or Control programs reached the .05 level of sigm icanc 

3 . Critical Thinking, Grades 4, 5, 6 

During the year tests were designed to. measure such components °|\ cr,tlca1 
thinking as Recognition of Assumptions, Relational Logic, C * a *f . d to a 

Inference. A final form of the test with these scales was administere 
sample of approximately 90 intermediate grade children each “'"“i-Jif ; can t 
and in the control classes. Although small variations did appear, no s.gn.f .cant 
differences appeared between science programs. In the sixth gra e 
was noted between the control group and all three science programs which was s.g 
nificant at the .05 level in favor of the control. 



E, Discussion of Results 



This analysis has 
several points of view, 
entirely convincing. 



considered the effect of the science programs from 
The results have not been always in agreement nor 



From the teacher's point of view the Process and Concepts programs are 
judged effective with a need for modification of the Discovery program P a ^ c ' 
Ularlv in the primary grades indicated. From the parent s point of view, the 
Process and Discovery programs produced more positive effects in the child s 
out of school activities. The testing program indicates that improvements ,n 
■reative thinking were equally frequent in e jgth of the programs and 
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ontro?. The level of critical thinking measured was about the same in a 1 1 ^ 
rograms with the exception of a slight advantage of the Discovery program in 
he primary grades and the higher scores of the sixth grade control group, 
hile the influence of the curriculum on creative thinking was minimal, the 
nfluence of the individual teacher and the question of what teaching behavior 
roduces these effects must be raised. 

A major finding resulting from this year*s trial is that individual 
eacher differences in ability, teaching style and motivation are highly rele- 
ant factors which must be considered in curriculum modification. An optimum 
rogram would seem to require a set of options from which teachers can select 
he ^ -^am which best matches their teaching ability and style. 

This portion of the report must be ended with a note of caution about 
nterpiretat i on of the results, particularly for those readers outside the 
oulder Valley School District;. The authcrs of this report do not consider 
his year r s trial to be a definitive test of the relative merits of the 
everal programs involved. 

Many worthwhile outcomes of the science programs were not measured because 
\f time or technique limitation. Among these were the extent to which children 
icquired process skills, science concepts, and the children^ attitudes about 
cience. In each case, the materials were used in a way which was subject to 
oca 1 interpretation, and departures from the intent of the authors of the. 
icience programs undoubtedly occurred. The Elementary Science Study materials 
n particular were modified and supplemented locally. In some cases, materials 
/ere used in trial teaching versions which were not ready for general release. 

The trial was conducted in the belief that it is better to base decisions 
>n incomplete data rather than on no data at all. The direction for future 
/ork in improving elementary science in this school district was more clearly 
ieftned as a result. 
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CHAPTER 111 - TEACHING STYLE INVESTIGATION 



A, Expos ? tory- I nduct i ve Observation System 

Obtaining the cr i t i cal -creat 1 ve thinking objective through the simple 
curriculum change process appeared unpromising* Yet an influence was being 
exerted by the teachers, at least insofar as creative thinking was concerned. 

One apparent problem was that of identifying what components of teaching beha- 
vior were contributing to changes in creative thinking. Such a problem led 
directly to the currently active field of inquiry into the nature of the inter- 
actions between teachers ar.d students. 

From various frames of reference observers of classrooms have formulated 
observation schedules and behavior category systems which reduce the data rich 
environment of classroom to numerical form for analysis. The complexity of the 
environment, coupled with a multitude of reference frames and tlieors cal con- 
structs, has resulted in systems of interaction analysir v.-ich number well over 
one hundred (l). After a reasonably thorough search it -sic concluded that although 
there were several related systems, such as Flanders (2) Teba (3), none seemed 
to fit the problem at hand. A particular element of interest, which was missing 
in existing systems, was the interactions of children :h materia s constitu- 
ting the environment of a science classroom. 

A relationship should exist between a teacher's ry.e of interacting with 
the students in a class and the thinking behavior exhib ^ d by the students 
under the teacher's influence. Students who are typical > required to act and 
produce should be distinguishable from thc^e students w ho are typically required 
to accept and reproduce information. The task was, therefore, twofold; first, to 
develop a system of observation that included the relevant variables of teacher 
behavior and second to devise a means of measuring the changes in student's 
thinking. An analysis by Glaser (4) suggested the classification of teaching 
strategies as inductive or expository and led to the design of the instructional 
analysis system. 

A first dichotomy was established between the general sort of actions by 
which the teacher manages the activities of a class and the actions which con- 
stitute instruction. Management functions include procedural and rapport main- 
tenance tasks and their form should be Independent of the subject under instruc- 
tion. 



(1) . Simon, Anita and Boyer, G.E. (Eds.). Classroom Interaction 
Newsletter, Vo 1 . 4, No. 2 , May, 1963. 

(2) . Flanders, Ned A., Interaction Analysis in the Cj a5_s room, A Manua l 
for Observers . University of Michigan, School of Education, Ann Arbor, 

Michigan, 1966. 

(3) . Taba* Hilda. Teaching Strategies and Cognitive Funct i on t ng _i n_ 
Elementary School Children . San Francisco State College, San Francisco, 1966. 

(4) . Glaser, Robert. “Variables in Discovery Learning, 11 In Learning by, 
D i scoverv . Shulman, L. and Keislar, E.R. (Eds.). Rand McNally, 1966. 



I n5truct ional functions are 
cr? bed as fol lows: 

I . Exp ository Teaching 



classified as expository or inductive 



( L) ^ (T) ^ — -)(R) 



The diagram shows interactions between the teacher (T), the learner (L.), 
phenomenal reality (R). Arrows represent interactions between the compo- 
ts. In this mode of teaching the teacher serves in the role of interpreter, 
laining reality to the learners. This includes such activities as asking 
stions and reinforcing correct responses, answering student questions, citing 
horitative sources, demonstrating through the manipulation of equipment and 
narrative explanation. 

(L) >(R) 



Inductive Teaching 



Ki 



(T)t- 






The second diagram uses 
inductive mode. In this mode 
ect c >nt ct with reality. The 
to cause ~he student to search 
this mod-^ of teaching is the circumstance in whi 
m real it*/ without the teacher*s interpretation. 



the same symbols to depict interactions under 
the teacher acts to place the student in 
teacher responds to questions in such a way 
for his own answers. The essential ingredient 

h students receive feedback 



Event Codes 



A more detailed description of the teacher behavior events which were 
orded, and the coding utilized, is seen in the following summary. 

I. Instructional Events (inductive or Expository Teaching Behavior) 

1. Manipulates environment 

2. Asks question 

3 * Listens to student 

4. Responds to student question 

5. Makes statement of fact 

6. States opinion 

II. Managerial Events 

A. Rapport maintenance 

A+ Positive affective action (encouragement, praise, etc.) 

AO Heutral affective action (arbitration of dispute, etc.) 

A- negative affective action (threat, display of anger, etc. 
P. Procedural actions 

P(l) Verbal procedural instructions 
P(2) Mon verbal procedural actions 

III. Other Events 



HO) 

H(2) 

S 



Un i nterpretable event 
Missing data (video tape malfunction, 
S i 1 ence 
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etc. ) 




:erva 



A sample observation is as follows: 

0 - 0 - Q 



N 0' 



3, 4, 1, 2, A+, P 2 A 

1 : 2 : 3 : : 5 : & : 7 : 8 : 9 



: would mean the following sequence: Teacher listens to a student, respond 

:he student's question, manipulates a piece of equipment, asks ^ ^^t.on, 
,urages the student to try th same manipulation, ard oversees the studen 
v i tics without comment. The overall rating for the events of the minute 
: hree scale units toward the inductive side of neutral. 

The determination of whether an inductive or expository 1 "Struct ional 
;tion is being served require the observation of a sizable aw o e havor 
an inference on the part of the observer. As a result of cons derab . ex 
imentation an observation interval of one minute was se ected and a global 
ing of that interval on a nir e position scale from totally inductive to 
ally expository was made. 



-ed observers. The team 
;._dent in the field of 
-f science education and 



The use of such a syste- clearly requires t“s 
observers in this study cons sted of a graduate s 
iic.ci psychology, a graduat- student ;n the field 
th grade teacher. 

This team collaborated in the development of the observation system and 
ined themselves in its use by viewing filmed and videotaped exemp 
active and expository teaching. A segment of recorded teaching behavior was 
*ed and rated. The observers would compare their ratings and discuss d.s 
Dancies They would repiay the segment and attempt to resolve 

01 p.J .v«ti were cues to the teaching style inferences made. 

this manner the team was able to operationally define the rating system and 
e able to converge to the point that a satisfactory inter-judge reliability 
« . 792 ) was obtained for independently rated videotapes. 



Critical and Creative Thinking Tests 



Science") evolved into 
Science." These were 



Several preliminary tests ("Critical Thinking in 
3 "Boulder Tests of Critical and Creative Thinking in_ Th 

TStructed to assess changes in the domains of the project s o j 

tu 
rts 

convergent product ion 



reofthesei nst ruments and their origin is described in the foil owing two 
s; first, creative thinking or divergent production, then critical thinking 



1. Creative Thinking in Science 

Taylor(5) has pointed out that students should be considered as "thinkers. 



(5). Taylor, Calvin W. "Scientific Creativity: Its Recognition and 

svelopment, “ Thirteenth Annual Convention of the national Science Teachers 
sociation, Denver, Colorado: March 28, 1965. (Mimeographed), 




ucers, and creators rather than solely as learners, recorders or memorizers. 

paper praved to be a precursor to a substantial interest with? • the science 
atio; comunity in the proposition that since progress in scie ce is dependent 
:reat:’/e production, Brono' ?ki(6), Taylor and Barron(7), creatr. ty or divergent 
luction is a significant elective of science education. A ocau on the topic 
’ilcz and Sund (o) has appeared and studies on the effects of sc ence instruct :n 
;reativity are included in the extensive new literature on the general topic c 
itiv.zy. Accepting divergent production as a proper objective of education in 
:nce suggests the question: "Is it a measurable outcome? 11 Can means be devel- 
I to determine to what extent this objective is being achieved? Work by Torra. 'e 
0) suggests an affirmative answer to this question and also provides patterns 
suer measurements. The Torrance pattern was followed in the development of a 
,urc of divergent production within the content of elementary science. 

Eicht open response items were developed, two in each or the following 
sgories: guessing causes, asking questions, unusual uses, and inproving a tool. 

;e were assembled into two alternative forms (called Form G and rorm H of the 
der Test of Critical and Creative Thinking). The items were designed to pos^. a 
>lem which was clearly stated but which had a multiplicity of pcssible solutL.rs, 
i item was at the top of a sheet of paper with twenty blank nunibared 1 ines 
jrneath. A sample item pair is as follows. Instructions written in capital 
:ers were common to each item. 



IMPROVING A TOOL 

5 ACTIVITY VI ILL GIVE YOU AM OPPORTUNITY TO THINK OF WAYS TO IMPROVE SOMETHING 
CHAT IT WILL BE BETTER OR MORE USEFUL. 

Form G or Form H 



ay needed something to lift pieces 
netal out of hot water. He made a 
1 out of two strips of metal by con- 
ting them together with a boldt. The 
1 works something like a pair of 
ssors. 



A boy needed something to carry pieces 
of dry ice. The dry ice is so cold that 
it would hurt his hand if he held it 
with his fingers. He made a tool by 
fastening a tin can lid to a wire handle 
from an old fly swatter. The tool works 
something like a spoon. 



NK OF AS MANY DIFFERENT WAYS OF IMPROVING THIS TOOL AS YOU CAN. THE CHANGES 
IJLD MAKE THE TOOL EASIER TO USE OR MAKE IT MORE USEFUL A TOOL FOR HANDLING THINGS 
T ARE TOO HOT, TOO COLD OR DANGEROUS TO TOUCH. LIST ALL OF THE WAYS TO IMPROVE 
S TOOL ON THE SPACES ON THIS PAGE. USE THE BACK OF THIS PAGE IF YOU NEED MORE 
CE. 



(6) . B ronovjs k i , J. "The Creative Process," Scientific American, .Volume 
, Number 3 . September, 1953. 

(7) . Taylor, Calvin W. and Barron, Frank (eds.). Scientific Creativ ity.:. 
Recognition and Development . Selected Papers from the first, second and third 

versity of Utah Conferences. New York, N.Y.; John Wiley & Sons, Inc., 1963 

(8) . Piltz, Albert and Sund, Robert. Creative Teaching of Scienc e i n_ -the 

imentarv School : Boston, Mass.: Allyn and Bacon, Inc., 1968 

(9) . Torrance, E, Paul. Guiding Creative Talent . Englewood Cliffs, N.J.: 



:nt i ce Hal 1 , 1962 . 

(lO). Torrance, 
I. : Personnel Press, 



Paul 
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The text of the item /as read aloud by the examiner and the children 
.'ere allowed 10 minutes tc- complete each item. A model of one or the other 
jf the c-cde tools was exh sited during the presentation of the improving 
3 tool i :em. Since the scaring procedure was developed contemporaneously 
vith the study, the prete: r spons.s were used to produce a scoring 

procedure “or the items. .asoonses from each pretest booklet were written 
on a sepc-ate slip of rap r croducing a tray full of approximately 2,500 
differer:; responses “-T es of the eight items. 



Three different measures of divergent production were developed out of 
these responses: fluencv— the number of responses; f lexibi 1 1 ty— the number 

of different categories : n wh i ch responses were given; and or i g i nal i ty— the 
statistical infrequency of responses (i.e., frequently given responses scoriae 
low and original or u-r que '"esponses scoring high).. The fluency score was 
arrived at by simply counting the responses to the item. The flexibility 
score necessitated sortie the 2,500 responses into emp i r i cal 1 y . determi ned 
categories. The categories were then related by imposing a logical structure 
to reduce overlap betw~" categories and to facilitate test scoring. The 
flexibility scoring matrix for improving a tool, Form H, is shown in. Table 
IX. The responses for each item were classed in such a category matrix 
with the number of categories varying from twenty to thirty-five. 



TABLE IX. RESPON-c MATRIX PRODUCT IMPROVEMENT - FORM H 



>^^Substance Change | 1 t 2 

Function Change v \. i l 


3 


4 j 5 


6 


Unspeci f i ed 




376 * ! 277 

i 


517 j 


250 


20 


Mechanical Properties j 2 \h 


22 i 45 
1 


117 


28 


1 


Heat Conductivity j 1 88 


0 


21 


13 


5 


0 


Safety 


25 


2 


9 


18 


j 2 

1 . 


0 


Decorative 


19 


0 


0 


1 


1 


0 


Other Functional Changes 


18 


l 

I '1 

\ 


1 1 


3 


0 

1 


0 



1. Unspecified Substance Change 4 . Material Addition 

2 . Gross Dimensional Deformations 5 . Material Substation 

■3 shaDe 6. Other Substance Changes 



* 376 responses were classed in the category of Gross Dimensional 
Deformations with no change of function mentioned. 



The originality value for each response was determined by further sorlir._ 
responses until identical or equivalent responses were together. Equivalent 
responses were those which gave the same solution to the problem but had different 
wordings or sentence constructions. The number of times a response was given 
determined and a frequency distribution plotted. These distr butions were J-snaped 
with a large number of unique resoo»-sos and typically one response given by one 
hundred or r- -re students. A standard deviation for the distribution was deter- 
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-es for 1 , 2 and 3 sigrna units were established. These 
-ans 1 ated into the following originality weightings. 



mined and cut t ) r 
cutting scores w- 



Occurrence 
Among 250 
Respond i ng 


Approximate 

% 


Original i ty 
Points 


1 or 2 


1 


3 ... 


3-11 


1 - 4 


2 


12-29 


\J1 

1 

o 

J 


1 


30 or more 


10 


0 



The categc —/ matrix and originality weightings were assembled into scoring 
booklets for each item. By that time eight months had elapsed and the alternate 
forms of the test were again administered as post tests. The scoring booklets were 
then used to score the original pretest booklets and the post tests. 



2, Critical Thinking in Science 

Critical thinking has a long history as an objective for education (II) 
in general and for elementary science education (12) in particular. Er orts 
at measuring critical thinking have paralleled its inclusion as an objective, 
leading to Watson and Glasser (13) who produced a five scale test of critical 
thinking for adults and teenagers and to the work of Ennis (14) who pro uce 
tests of class and conditional reasoning for ages 10 to 18. 



(H). Dressel. Paul. '‘Critical Thinking: The Goal of Education." 

National Education Association Journal, Vol . 41 , 1955. NEA. 

(12) . Dunning, G. M. "Developing Critical Thinking Through 
Elementary Science." School Science and Mathemati cs, Vol. 51 » '951 . 

(13) . Watson, G. and Glasser, E. M. "Watson-Glssser Critical 
Thinking Appraisal, Manual for Forms YM and ZM." Harcourt, Brace and 
World, Inc,, New York, 1964, 

(14) . i r. H. "Critical Thinking Readiness in Grades 1-12 

(Phase I: De jc Reasoning in Adolescence) •'* Cornell University, 

1964. (Mimeograph- project report). 
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While providing valuable guidance, neither of these sources had 
produced the appropriate test for the question at hand* The Watson- 
Glasser tests were designed for an older population of subjects and the 
Ennis tests were only for deductive logic, an important but not exhaustive 
component of critical thinking. 

Work on an appropriate critical thinking test was begun early in 
the project. I terns were written to fit conceptually into one of the 
critical thinking scales. The items were then assembled into tests and 
administered to groups of intermediate grade children. Responses to 
these early tests were then analyzed by a modified factor analysis (15) 
to establish what emperical evidence for critical thinking scales 
supported the conceptual design. Substantial revisions of these tests 
were made to improve the scaling properties. 

The results of this work were tests of twenty-six items in each 
of three scales called Assumptions, Inference and Reasoning* These 
scales were parallel to the i/atson-Gl asser scales "Recognition of Assump- 
tions"? "1 nference" and "Deduction 11 , respectively. Efforts to produce 
scales parallel to the Watson-Gl asser scales M 1 nterpretat i on M and 
"Evaluation of Arguments" were unsuccessful. Forms G and H were parallel 
forms and were assembled with the forms G and H of the creative thinking 
items described above. This composite test, identified as the "Boulder 
Test of Critical and Creative Thinking", was administered in two forty- 
five minute sessions. 



3* Scaling Properties of the Boulder Test of Critical and 
Creative Thinking 

In the teaching style study, the alternate forms of the BTCCT 
were administered so that half the population took Form G as a pretest 
while the other half took Form H as a pretest. Similarly, half took 
Form G as a post test, the other half took Form H as the post test. 
These data obtained from these administrations were analyzed with a 
scale scoring program ( 1 6) which computes scale variances, scale 
correlations and two statistics of scale reliability, ChronbacMs 
Alpha (17) and Scott’s Homogeneity Ratio (18). 



(15) . Tryon, R. C, and Bailey, D. E. (ed.) Users Manual of the 
BCTRY System of Cluster and Factor Analysis, Tape Version for 7Q9 , 7090 > 

ToW 'of July 31 r r 955 T~ 

(16) . Jones, Richard. S cale Scoring Program I BS 234, University 
of Colorado Institute of Behavorial Science, April, I 969 "(mimeographed) . 

(17) . Chronbach, J. L. "Coefficient Alpha and the Internal 
Structure of Tests", Psychometr? ca , 1951 » 16 . 

(18) . Scott, W* A* "Measures of Test Homogeneity", Educ . Ps ychol . 
Measurement , I960, 20 . 
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a. Form G as Pretest, number of subjects n ** 236 



Scale Chronbach’s 

Alpha 


Scott's 
Homogene i ty 
Ratio 


Items 


Mean 


Var i ance 


Assumptions 


.554 


.123 


26 


,88 


.15 


Inference 


.**95 


.090 


26 


.43 


.20 


Reasoning 


.800 


.177 


26 


.68 


.20 


Fluency 


.831 


.581 


4 


9.80 


4.68 


Flexibility 


.681 


* 356 


4 


4.37 


1.42 


Original ity 


.797 


.521 


4 


11.52 


7.44- 




Scale 


Correlation Matrix 








1 


2 3 


4 


5 


6 


1, Assumptions 


- 


.242 .341 


.172 


.269 


.169 


2. inference 




.433 


.192 


.225 


.200 


3. Reasoning 




- 


.325 


.322 


.314 


4, Fluency 








.799 


.917 


5. FI exibi 1 i ty 








- 


..781 


6. Original ity 
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b. Form 6 as Post test, number of subjects n - 235 



Seal e 


Chronbach's 
A1 uha 


Scott's 
Homogene i ty 
Ratio 


I terns 


Mean 


Vari snee 


Assumptions 


.583 


.136 


26 


.89 


.15 


Inference 


.587 


.125 


26 


.45 


.22 


Reasoning 


.817 


.192 


26 


.67 


.21 


Fluency 


.829 


1 

• 

0 


L 


11.15 


5.14 


Flexibi 1 i ty 


.663 


.3*13 


4 


4.86 


1.50 


Original i ty 


.731 


.416 


b 


12.87 


7.47 



Scale Correlation Matrix 



1 2 3 4 5 



1. Assumptions 


.238 


.254 


.207 


.215 


J9D 




2. Inference 




.275 


.270 


.289 


.302 




3. Reasoning 




- 


.274 


.343 


.323 




4. Fluency 








.798 


.904 




5.' Flexibility 








- 


.764 




6. Original ity 















33 




-27 



c. 



Form H as a Pretest, number of subjects n - 235 



Scale Chronbach's 

A1 oha 


Scott 1 s 
Homogeneity 
Ratio 


1 terns 


Mean 


Var i ance 


Assumptions 


.570 


.135 


26 


.79 


.19 


Inference 


.669 


.155 


26 


.52 


.23 


Reasoning 


.820 


.187 


26 


.65 


.21 


FI uency 


.835 


.575 


4 


8.84 


4.35 


FI exib i 1 i ty 


.716 


.390 


4 


4.12 


1.47 


Original i ty 


• 726 


.494 


4 


12.19 


7.32 




Scale Correlation 
1 2 3 


Mat r i \ 


5 


6 


1. Assumptions 


- 


.409 .409 


.177 


.262 


.151 


2* Inference 




.527 


.315 


.462 


.295 


3. Reasoning 




- 


.304 


.397 


.273 


4. Fluency 






- 


.829 


.922 


5. Flexibi 1 i ty 










.791 


6. Ori ginal i ty 










- 
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d. Form H as a Post test } number of subjects n = 286 



O 

ERIC 



Seal e 


Chronbach 1 
A1 pha 


Scott 1 s 

's Homogeneity 
Ratio 


1 terns 


Mean 


Variance 


Assumptions 




. 588 


. 148 


26 


.86 


.16 


Inference 




.629 


.134 


26 


.62 


.22 


Reason i ng 




.IS 1 * 


.166 


26 


.71 


.18 


Fluency 




.872 


.653 


4 


10.18 


5.28 


FI ex i b i 1 i ty 




.722 


.409 


4 


4.63 


1 .50 


Or i g i nal i ty 




.032 


.576 


4 


12.88 


8.42 






Scale Correlation Matrix 










1 


2 3 


4 


5 


6 


1. Assumptions 


mm 


.326 .389 


.164 


.264 


.165 


2» Inference 




.465 


.154 


.215 


.120 


3. Reasoning 




- 


.276 


.368 


.. 249 


4. Fluency 








M 


.734 


.909 


5. Flexibility 










.829 


6 P Original 


i ty 










- 
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Form 1 was developed by combining forms G and H for a separate 
•pose. The administration of this test and subsequent analysis provides 
opportunity to investigate the relationships between the several 
tical and creative scales and I.Q. , Achievement, and two non-verbal 
•formance measures. This test was administered to 210 fifth and 
<th grade students in January 1969 (19). The test properties and 
:errel ationships between it and other measures are shown in the 
lowing tables. 



Test 


Chronbach 1 s 
Alpha 


Scott 1 s 
Homogene i ty 
Ratio 


Items 


Mean 


Variance 


BTCCT Scales 

Assumptions 


.721 


. 10*} 


26 


.83 


.12 


1 nference 


.550 


.0'(6 


26 


,60 


.13 


Reason i ng 


*790 


.120 


26 


.70 


.18 


FI uency 


.710 


.443 


3 


10.23 


4 . 1 6 


Flexibi 1 i ty 


.50.' 


.256 


3 


5.03 


1 .41 


Original i ty 


. 682 


.419 


3 


13.53 


7.12 


Stanford Science 
Achievement Test 


„ o2*J‘ 


.070 


58 


.57 


.14 


Perfo rmance 
Test #1 


.606 


.053 


40 


.44 


.12 


Perfo rmance 
Test #2 


.477 


.030 


30 


.44 


.11 


I.Q.. (Lorge- 
Thorndike Form 2) 


- 




- 


110.47 


1 1 .43 



TABLE XIX 



(19). Mutually Aided Learning Project, Cherry Creek Public Schools, 
glewood, Colorado. Albert Thompson, Director. 
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Correl atio. Matrix 





1 


2 3 4 


5 


0 


-i 

/ 


8 


9 


10 


1. 


Assumptions 


.275 .3*50 .070 


. 142 


. 094 


. 343 


.149 


.321 


.319 


2. 


Inference 


- .463 -219 


.276 


.25 


.417 


.339 


.355 


.501 


3. 


Reason i ng 


,247 


.302 


.255 


.491 


.301 


.354 


.530 


4. 


FI uency 


mm 


.720 


* 800 


.293 


.2.11 


.005 


.239 


5. 


FI exi b i 1 i ty 




- 


.700 


.347 


.101 


.221 


.311 


6* 


Original i ty 






- 


.313 


, 242 


.159 


.270 


7. 


Science 

Achievement 










.501 


.505 


.591 


c. 


Perfo rmance 
Test 7/1 










- 


.500 


.409 


9. 


Performance 
Test #2 












mm 


.425 


10. 


1.0. 














- 




The data above 


falls short of ideal 


demonstration of 


the val i di ty 


9 



efficacy, and reproducab i 1 i ty of a new testing instrument. The data does 
show the following, however. First, the tests show reasonably consistent 
performances over what can be considered five separate administrations. 

Four of the six scales show a satisfactory homogeneity ratio falling between 
the .150 and .500 levels. Ratios above the .500 level suggest redundency 
in the scale so that items might be deleted with no loss of information. 
Ratios below .150 suggest the items in the scale do not measure a single 
unitary trait. The reliabilities (Chronbach's Alpha) are reasonable 
considering the length of the test scales. Doubling or tripling the 
number of items per scale would raise these values considerably but at 
a substantial cost in testing time required. For the purpose at hand, 
it was considered better to proceed with six relatively independent 
scales with roughly .7 reliabilities than to utilise all of the avail"" 
able testing time on a single trait even if the reliability of it 
could be raised considerably higher. 
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C , Results of the Teaching Style Study 



The two tools described in this chapte- were devel oped to^be appl i ed 
question of whether the source of the teacher ^ <->u 



to the q 
creative thinking could be 



i dent i f i ed # 



To this end a sample of fourth, fifth and sixth grade teachers ' 
drawn randomly from those participating in the project but not | nc 
the first year's testing program. These teachers and the principa 
their schools were contacted, the investigation was exp a ined and par 
pation was requested. Of the twenty-four in the initial sample, twen y 
teachers and their principals agreed to permit the testing and video- 
taping of their classes. 

Several important precautions were taken to insure the success of 
this relatively sensitive undertaking. The video-taping schedule ot 
classes in the teaching style study was merged with the video-taping ot 
exemplary teaching for use in in-service education. Being se ec e 
video-taping was therefore a relatively prestigious event. Anonymity was 
assured in the reporting of the findings and each teacher had the r g 
to review each tape and to order it erased if unacceptab e. 

Complete data was collected for eighteen classes. Th \ v 1 V* 1 ?! " 9 

was done with a Sony 2000 Video-tape Recorder mounted on a wheeled dolly 
so that it could be rolled from one position to another within the class 
while recording. The sound reception was augmented with a cordie 
transmitting microphone worn by the teacher. 

Approximately sixty minutes of teaching was rated for teacher. 

The raters followed the procedure described above and assigned an overa 
rating for each minute on the expos i tory- i nducti ve continuum. ese 
values were averaged, yielding a score for each teacher. As no e 
before, the inter-judge reliability of the ratings was .79 . 

Questions of interpretation arose concerning these scores. A 5 
rating might mean either that a teacher alternates between inductive an 
expository styles or that neither style was observed. On review o e 
data, it became apparent that large fluctuations between inductive and 
expository styles were not observed. There were consistent uses o a 
particular sty1« among teachers on both ends of the continuum. urc e , 
the raters agreed that the 5 rating was used essentially as a neu ra "e 
suggesting that the behavior observed did not fit the exposi tory- i n u 
model. As a consequence, the teachers were divided into three groups 
labeled expository, indeterminate and inductive, and the analysis was 
made on this basis. Forms G and H proved to be significantly different 
in difficulty so an adjustment was made by adding an appropriate constant 
to the mean of each scale. 

Adjusted difference scores were computed on a scale by scale basis 
by subtracting pretest from post test scores. 





These difference scores were then analyzed by means of a one 
way analysis of covariance with dicotomized pretest scores as t e 
covariate. The results are shown in the following table. 



Percentage Change in Scale Scores 



< 

Scale 


Expository! Indeterminate 
Style i Style 


1 nduct i vs 
Sty 1 e 


T 

F 

Ratio 


S i gn i f i cance 
Level 


Assumptions j + 1.7% 


- 2.9% | + 1.0% 


3.18 j .95 


* — 4 — " — ~ ' 

Inference 1 -0,8% 


+ 1.3% 


+ 2.2% 


1.19 j ns 


Reasoning j * 0.9% j 


! - 4.1% 1 


+ 3.0% 


8.87 j .99 


Fluency \ + 6.2% 


! - 9.5% 


+ 2.4% 


6.26 I 


| .99 

i 


FI exi bi 1 i ty 


+ 4.5% 


- 4.3% 


- 0.9% 


4.26 


| -95 


Or i gi nal i ty 


j" -5- 4.0% 


-14.1% j + 9.2% | 9.57 


.99 



TABLE XXI n = 5 1 9 » 2 and 515 degrees of freedom 



The most striking outcome is the difference in changes 
obtained by children in the classes rated as indetermina e expository 

dominately losses, while gains occurred in both classes rated as P obta;r / 
and classes rated as inductive. In brief, it appears that benef ts obta.n 
to children in classes where the teacher displays a teaching style but 
that it doesn't seem to matter if that style is expository or inductive. 

The differences are most noticeable in the creative th.nking sea e . 

There are several interpretations of these results that could be 
made. The simplest is that teachers who design and carry ou ins c 
seouences which have apparent direction and organization p nt - rn ? eta ti on 
effects on the students' thinking abilities. An alternate interpretation 
applicable particularly to the creative thinking scales has to 
consistency and inconsistency. Inductive or expository rat '^ e 
associated with consistent performances by the teachers. Children n 
cl asses where the teacher is consistent should feel more freedom to respond 
in original or humorous ways when asked, while children in classes where 
the teacher is less predictable would be more constrained in giving 
original responses. 
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CHAPTER IV - SCIENCE PREFERENCES OF TEACHERS 



Curriculum designers have oroduced science materials which deal in 
different ways with the problems generated by rapid technological change 
and exponential growth of knowledge. The diversity of approaches to 
elementary science seems to be due to differing psychologica an 
philosophical frames of reference of the curriculum designers, an e 
trial use of new science materials suggested that these different frames 
of reference are repeated among the project teachers. Many o t e 
differences appear to be deep-seated and not susceptible to easy mo i- 
f i cat i on. 



Data from the first year's trial did not support a single program 
over the others and a significant fraction of the teachers encountered 
difficulty with each program. The most promising course of action appeared 
to be recognition of the substantial individual differences among teac ers 
by providing them a choice of program. In order that the choice be an 
informed one, teachers not participating in the project were invited to 
in-service sessions where they engaged in activities representative oi tie 
programs . 

On May 2, 1968, a questionnaire was distributed to all teachers of 
grades one through six, asking them to indicate their selection betw. 
two alternative science curricula. The two programs are describe in t e 
following paragraphs. 

Science Concepts - This program includes the Harcourt, Brace and 
World Concepts in Science text series and associated laboratory 
kits. Texts will be available on an individual student basis and 
the laboratory materials are available in such quantity that 
investigations can be done by the teacher or by groups of students 
on a demonstration basis. At each grade level units are provi e 
in each of six conceptual schemes. 

Science Skill s and Discovery - This program includes units selected 
f rx ii the material produced by AAA5 and ESS, !n grades 1, 2 and 3> 
an emphasis on process skills will predominate but Some time will 
be spent on discovery activities. In grades 4, 5 and 6, emphasis 
will be placed equally on process skills and scientific inquiry. 
Laboratory materials will be sufficient to have students working 
indi vidually, in twos, or teams of five or six. Reading will be 
limited to reference material as a text is not used. 



The results of this selection are shown in Table XX 11. 





Science 


Science 


Grade 


Concepts j 


Ski 1 Is & Discovery 


— — ■ ■ ■ i 

i 

i 1 


50% j 


50% 


! 2 1 


48% 


52% 


3 


57% 1 

1 


43% 


4 


46% | 


54% 

l 


5 


26% 


74% 


6 


4o% 


60% 



1 



TABLE XXII Percent of 392 Teachers Choosing 
Different Science Programs, 1 9<SB 



i nformat ion, 
at all grade 



it is clear that 
levels preferred 



s i zable 
each of 



the 



On the basis of this 
proportions of the teachers 
two programs. 

In order to accommodate the differences in sttuBtlon . onal 
instructional style and to provide material with which the JJJ r ^ ,0n 
staff had confidence, adoption of both programs as alt 
accomplished for the 1 968-69 school year* 

Again in the spring of 19&9 a similar questionnaire 
buted offering the same two alternatives for the 1969 97 



The results of this second selection are shown in the following 



table. 
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,de 

i 


Science \ 

Concepts j 


Science 

Ski 1 Is & Discovery 


===== — — — 

i - i 


57% 


43% 


! 2 i 

i 


56% j 


44% 


3 i 


69% i 

| 


31% 




j 60 % 1 


40% 


S~ 5 


41% 


1 59% 

1 _ — 


1 — — — — — 

! 6 

j 


52% 

i 


48% 



TABLE XXI ! I Percent of 408 Teachers Choosing 
Different Science Programs, 1969 



The concepts choice shifted from .".htly ' ^ ^^"essent ! e, If “ 

9 raie consistently more toward the 

non- text choice than any other grsde* 

With the shifts in science curriculum occurring as a result of 

teachers exercising their options the opportunity .of c cm pan" 

■ - *- the schools used in the first year s u i» 



text and text choices in tne scnoois useu m •- • ' _ , teachers 

d resented itself In the intermediate grades about half of the teachers 

were using the text approach but they were now c es°?esu!tin g 

the schools. It was thus possible to examine any 

from a combination of the text program with tea ^ h ® rs . wh ° ' ch ° ®. chose 
program compared to the non-text program as used by teachei s 

that program. 

Form I of the "Boulder Test of Critical and Creative Thinking" 
was available and in addition the STEP Science Achievement Tests { 20 ) 
were obtained. 

Thirty-six classes were selected from the schools in the initial 
comparison by choosing six text and six non-text classes at eac gra e-~ 
fourth, fifth and sixth. This gave a student population of slightly 
over 700. The classes were tested in May, 1969. 



The results are shown in Table XXIV. 



(20). Educational 
Progress, Science, Forms 



Testing Service, "Sequential 
3A and 4A"_ Princeton, N. J., 

42 



Tests of 
1962 . 



Educat i ona 1 



- 





Grade j 

4 j 


Grade 

5 


Grade 

6 


! 

Non- j 
Text j 


Text 


Conf \ - 
dence 
Leve } 


1. Assumptions 


17.9 i 


20.7 


23.5 


j 22 - 9 4 


18.5 


.99 


2. Inference 


12.6 ! 


14.4 


15.3 


nut 

J - -j. 


13.0 1 


.99 


3. Reasoning 


24. 4 j 


26.9 | 


j CM* 


! 31.2 | 

J_ 4 


24.8 


.99 


4. Fluency 


17.0 


17.0 


1 17.9 

1 


| 17.3 


17.4 


ns 


5 . Flexibility 


11.9 


| 12., 8 


13.9 


: 13.5 
. — — 


12.3 


.99 

r- — — — 


6. Originality 


13.4 


| 14.0 


| 15.5 


| 14.7 



13.9 


' .95 


Critical Thinking 
Scales 1 , 2 and 3 


54. 7 


1 

| 62.3 


71.4 


i 

69.2 


56 . 4 


; .99 
-1 


Creative Thinking 
Scales 4, 5 and 6 


42.4 


-i 

43.6 


1 

j 47.1 


j 45.2 


43.5 


' .99 

! : 



TABLE XXIV 1968-69 Comparison of Text and 
Non" text Science Programs, N — 729 



The results of the achievement testing are shown in Table XXV. 
Level 4A was administered to the fourth grade students and level 3A was 
administered! to fifth and sixth grade students. The a a ,n ® 
are presented in converted score form to provide for compara 1 1 y 

between the two levels. 





Mon- text 


Text 


Conf 1 dence 
Leve 1 




Fourth 


269.8 


271.0 


ns 


Fifth 


283.2 


273.9 

L . — — — 


ns 


S i xth 


276.9 


| 278.3 


ns 


Tota 1 


276.6 

4 — — — 


j 274.1', 


ns 



TABLE XXV 



STEP Science Achievement Converted 
Scores 





37 



prograJwuplod w??h”«chS£ «ho ^r?h«pro9r« is 

feis*3 etc Voss ^risi.-r-— 

by the STEP Science Achievement Test and the Biu.1. 
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